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■ Abstract. The induced representation Indus' of a locally compact group G is the 
I unitary representation of the group G associated with unitary representation S* : _ff — > 

U (V) of a subgroup H of the group G. Our aim is to develop the concept of in- 
^ I duced representations for infinite- dimensional groups. The induced representations for 

infinite-dimensional groups in not unique, as in the case of a locally compact groups. 
I It depends on two completions H and G of the subgroup H and the group G, on an 

■ extension S : H ^ U {V) of the representation S : H U {V) and on a choice of 
the G-quasi-invariant measure /i on an appropriate completion X = H\G of the space 

'■ H\G. As the illustration we consider the "nilpotent" group Bq of infinite in both 

P> \ directions upper triangular matrices and the induced representation corresponding to 

the so-called generic orbits. 
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1. Introduction 



The induced representations were introduced and studied for a finite groups by F.G. 
Frobenius. Our aim is to develop the concept of induced representations for infinite- 
dimensional groups. 

The content of the article is as follows. Section |2] is devoted to the notion of induced 
representations elaborated for a locally compact groups by G.W.Mackey [TH [15] and to 
the Kirillov orbit methods |1] for the nilpotent Lie groups i?(?T,,M). 

In Section [3] we extend the notion of the induced representations for infinite-dimensi- 
onal groups. We start the orbit method for infinite-dimensional "nilpotent" group Bq, 
construct the induced representations corresponding to the generic orbits and study its 
irreducibility. 

In Section m we remind the Gauss decomposition of n x n matrices (Subsection 14.11) . 
and Gauss decomposition of infinite order matrices (Subsection 14.21) . 

More precisely, we give the well-known definition of the induced representations for a 
locally compact groups in Subsection 12. 1[ In Subsection 12. 21 we remind the Kirillov orbit 
method for finite-dimensional nilpotent group Gn = -B(n, M). The induced representa- 
tions, corresponding to a generic orbits of the group Gn are discussed in Subsection 12. 3[ 
In the Subsection 12.41 we give a new proof of the irreducibility of the induced representa- 
tions corresponding to a generic orbits in order to extend the proof of the irreducibility 
for infinite-dimensional "nilpotent" group Bq. 

In Subsection 13.11 we remind the definition of the regular and quasiregular represen- 
tations of infinite-dimensional groups. As in the case of a locally compact group these 
representations are the particular cases of the induced representations. This gives us 
the hint how to define the induced representations for infinite- dimensional groups. The 
definition is done in Subsection 13.21 The questions concerning the development of the 
orbit method for infinite-dimensional "nilpotent" group Bq and Bq are discussed in 
Subsection 13.31 

The completions of the initial groups G are necessary to the definition of the induced 
representations for the initial infinite-dimensional group. The completions of the induc- 
tive limit G = lim Gn of matrix groups Gn are studied in Subsection 13.41 and 13.51 We 



show that the Hilbert-Lie groups appear naturally in the representation theory of the 
infinite-dimensional matrix group. We define a family of the Hilbert-Lie group GL2(a) 



(resp. Bq = lu^ B{2n — 1,M)). We show that any continuous representation of the 
group GLo(2oo,M) (resp. Bq) is in fact continuous in some stronger topology, namely 
in a topology of a suitable Hilbert -Lie group GL2(a) (resp. B2{a)) depending on the 
representation. 

In Subsection 13.71 we construct the induced representations of the group Bq corre- 
sponding to a generic orbits. The irreducibility of these representations is studied in 
Subsection 13.81 The very first steps to describe some part of the dual for the group Bq 
and Bq are mentioned in Subsection 13.91 



2.1. Induced representations. The induced representation Ind^^S is the unitary rep- 
resentation of a group G associated with a unitary representation S : H ^ U(y) of 
a closed subgroup H of the group G. For details, see [7], Section 2.1. Suppose that 
X = H \ G is a right G— space and that s : X — > G is a Borel section of the projection 




2. Induced representations, finite-dimensional case 
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p : G — 7- X = H\G : g i— ?■ Hg. For Lie group, such a mapping s can be chosen to be 
smooth almost everywhere. Then every element g E G can be uniquely written in the 
form 

(2.1) g = hs{x), heH, x e X, 

and thus G (as a set) can be identified with H x X. Under this identification, the 
Haar measure on G goes into a measure equivalent to the product of a quasi-invariant 
measure on X and a Haar measure on H. More precisely, if a quasi-invariant measure 
lis on X is appropriately chosen, then the following equalities are valid 

(2.2) dr{g) = ^^dfls{x)dr{h), 

^2 ON dfisjxg) ^ AH{h{x,g)) 

^ ■ ^ dftsix) AG{h{x,g)y 

where is a modular function on the group G and h{x,g) & H is defined by the 
relation 

(2.4) s{x)g = h{x,g)s{xg). 

Recall that a modular function on a group G is a homomorphism G 3 t ^ ^g(^) £ 
defined by the equality h^^ = AG{t)h, where h is the right Haar measure on G, L is the 
left action of the group G on itself and h^*{G) = h{tC). 

Remark 2.1. // the group G is unimodular, i.e Aq = 1, and it is possible to select a 
subgroup K that is complementary to H in the sense that almost every element of G can 
be uniquely written in the form 

(2.5) g = hk, heH, keK, 

then it is natural to identify X = H\G with K and to choose s as the embedding of K 
in G 

(2.6) s:K^G. 
In such a case, the formula ^2. ^j) assume the form 

(2.7) dg = AH{h)-^dr{h)dr{k). 

If both G and H are unimodular (or, more generally, if Adh) and Anih) coincide for 
h G H), then there exist a G- invariant measure on X=H\G. If it is possible to extend 
Ah to a multiplicative function on the group G, then there exist a quasi-invariant 
measure on X which is multiplied by the factor under translation by g. 

Now we can define Ind^S" (see [7], section 2.3.). Let S : H U{V) be a unitary 
representation of a subgroup H of the group G in a Hilbert space V and let /i be a 
measure on X satisfying condition (12. 3p . Let "H denote the space of all vector- valued 
functions f on X with values in V such that 



\\f{x)\\ydfi{x) < oo. 



Hi l^Vl'^ 

Let us consider the representation T given by the formula 



(2.8) [T{g)f]{x) = A{x,g)f{xg) = S{h) [ ] f{xg), 



dfisixg) 



1/2 
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where 



(2.9) A{x,g) 



S{h), 



and where the element h = h{x,g) is defined by formula ( ]2.4p . 

Definition 2.2. The representation T is called the unitary induced representation and 
is denoted by Indus'. 

Remark 2.3. The right (or the left) regular representation p, X : G ^ U{L'^{G,h)) 
of a locally compact group G is a particular case of the induced representation Ind^S* 
with H = {e} and S = Id. The guasiregular representation is a particular case of the 
induced representation with some closed subgroup H G G and S = Id. 

2.2. Orbit method for finite-dimensional nilpotent group B{n,'K). See Kir- 
illov [6] and [Tj, Chapter 7, §2, p.129-130, for details. "Fix the group G„ = B{n,R) 
of all upper triangular real matrices of order n with ones on the main diagonal. (The 
Kirillov notation for the group i?(?T,,R) is A^+(n, R)). 

The basic result of the method of orbits, applied to nilpotent Lie groups, is the 
description of a one-to-one correspondence between two sets: 

a) the set G of all equivalence classes of irreducible unitary representations of a con- 
nected and simply connected nilpotent Lie group G, 

b) the set 0{G) of all orbits of the group G in the space q* dual to the Lie algebra g 
with respect to the coadjoint representation. 

To construct this correspondence, we introduce the following definition. A subalgebra 
f) C g is subordinate to a functional / e g* if 

(/, [x,y]) = for all X,?/ G f), 

i.e. if f) is an isotropic subspace with respect to the bilinear form defined by Bf{x,y) = 
(/, [x,y]) on g. 

Lemma 2.4 (Lemma 7.7, [7J). The following conditions are equivalent: 

(a) a subalgebra () is subordinate to the functional f , 

(b) the image ofi) in the tangent space TjQ to the orbit Q in the point f is an isotropic 
subspace, 

(c) the map 

is a one- dimensional real representation of the Lie algebra ^. 

If the conditions of Lemma 12.41 are satisfied, we define the one-dimensional unitary 
representation Uf,H of the group H = exp f) by the formula 

Uf^Hi^W ^) = 6xp 2iTi{f,x). 

Theorem 2.5 (Theorem 7.2, [7]). (a) Every irreducible unitary representation T of a 
connected and simply connected nilpotent Lie group G has the form 

T = lnd%Uf,H, 

where H G G is a connected subgroup and / G g*; 

(b) the representation Tj h = Iiid^f^/.-ff irreducible if and only if the Lie algebra f) 
of the group H is a subalgebra of g subordinate to the functional f with maximal possible 
dimension; 
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(c) irreducible representations Tf^ jji o^nd Tf^ H2 ^.f^ equivalent if and only if the func- 
tionals fi and /2 belong to the same orbit of g* . " 

Example 2.6. Let us consider the Heisenberg group G3 — S(3,R); its Lie algebra Q 
and the dual space Q*. Fix the notations 



G = B(3,K) = {(;TS)}, 



f / xi2 xi3 \ ^ , , f / 

8 = M3,R) = {(oo„)},,- = n-(3.R) = {(g.,^;j 
The adjoint action Ad : G — )■ Aut(g) of the group G on its Lie algebra q is: 

(2.10) Q 3 X Adt{x) -.^ txt-^ e Q, teG, 
the pairing between the Q and g*: 

(2.11) 0* X 9 (y, x) ^ {y, x) := tr{xy) = ^ Xknynk e ^■ 

l<fc<n<3 

Since tr{txt~^y) — tr{xt~^yt) the coadjoint action of G on the dual g* to q is 

(2.12) 0* 9 y ^ Ad:(y) := (r^yi)_ eg*, i e G, 

where (z)- means that we take lower triangular part of the matrix z. 
To calculate Adl{y) explicitly for n = 3, we have 

1 tl2 tl3 \ ~^ / 0\ / 1 ti2 tl3 

1 t23 

.0 1 



hence 



t ^yt = [ 1 t23 ) J/21 ( 

V 1 / V 2/31 2/32 / V ( 

/ 1 -tl2 -tl3+tl2t23 \ / \ 

= 1 -t23 2/21 J/2ltl2 2/2ltl3 , 

VO 1 / V 2/31 2/31*12+2/32 2/31*13+2/32*23 / 

Ad*(y) := it'^yt)^ = f 2/2i-t232/3i oV 

^ ' V 2/31 2/31*12+2/32 / 



We have two type of the orbits O: 

1) if t/si = 0, then {^f ) =^ (1/21, 1/32) for fixed t/ai, Z/32 is 0-dimensional orbit; 

2) if yai 7^ 0, then ( J^^ r) is 2-dimensional orbits. 

In the case 1) fixe the point / = (1/21,1/32), the subordinate subalgebra [) coinside 
with all g, since [g, g] = (-E'13) := {^-£13 | t e M}. Corresponding one-dimensional 
representation of the algebra f) = g is 



g 9 X 1-^ (/, x) = tr{xf) ^tr ^0 T j 



•0 X12 X13 \ / 00 

2/21 00 



= a:;i2y2i + a:;23y32 e 



2/32 , 

The corresponding representation of the group G is 

(2.13) G 9 cxp(x) ^ exp(27ri(/, a;)) e S\ 

So we have 1-dimensional representation 

G3 3 exp Q Y ^23 ^ 1-^ exp(27ri(xi2y2i + 2:232/32)) e 5"^ 

We note that 

. . / X12 xia \ I \ X12 a;i3+ia;i2a;23 \ 

exp(a:) = exp 2^23 = 1 X23 

\o / \0 1 / 

In the case 2) we have two subordinate subalgebras of the maximal dimension 

/0 0X13\ /0X12X13\ Q, . ° S 

hi = 0:23 , and n2 = . Set / = 2/21 . 
\o / \o / •' \ 2/31 2/32 0/ 
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The corresponding one- dimensional representations of the subalgebras f)j, i = 1,2 are 

[)l 9 X (/, x) = Xi3t/3i + X23y32 ^ M, 
^)2^ X ^ (/, X) = Xi2y21 + Xiat/si G M. 

The corresponding representations S" of the subgroups Hi and H2 respectively are: 
Hi 3 (0 1 ^23 j = exp(x) ^ exp(27rz(a;i3?/3i + 2;23y32)) e •S'^ 

^2 3 (^0 1 j = exp(x) h-^ exp(27ri(xi2?/2i + a^isl/si)) G -S" . 
In the case Hi we have the decomposition = x B{2, R) ^ ifi k M, indeed we have 

K 5(2, M), 



3:^12 2^13 \ 




/I 


Xl3 \ 




X12 




1 2:23 




1 


r) 


(» 


1 




1 / 




V 




Vo 








hence the space X = Hi\G3 is isomorphic to 5(2, M) M and s can be choosing as the 
embedding s : 5(2, M) ^ 5(3, M). 

5(2,M)9(if)=:x^s(x)= (0?^) G5(3,M). 

For general n we have 

(2.14) 5(n + 1,M) = M" K 5(n,M). 

To calculate the right action of G on X i.e. to find h{x, t) such that 

s{x)t = h{x, t)s{xt), 
we have for x G 5(2, M) and t G 5(3, M) 

/ \ , / 1 x \ / 1 il2 tl3 \ /I a::+ti2 tl3+2^i23 \ / 1 tl3+xi23 \ / 1 X+tl2 \ 

SfXjif: = 1 1 t23 = 1 t23 =01 t23 1 

Vooi/Voo 1 / Vo 1 / Voo 1 / Vo 1/ 

= h{x,t)s{xt), hence h{x,t) = (^^^ ^^*23 j . 

Finally, the induced unitary representation Ind^^S* have the following form in the Hilbert 
space L'^{M.,dx) (case Hi and / = ysiE^i): 

(2.15) fix) ^ S{h{x, t))f{xt) = exp(27rz(ti3 + t23x)y3i)f{x + ti^). 
In the Kirillov [7] notations we have: 

/(x) h-> exp(27ri(c + 6x)A)/(x + a), 1/31 = A, Q *f ^23 ) = Q 1 fc) . 

2.3. The induced representations, corresponding to a generic orbits, finite- 
dimensional case. We show following A. Kirillov [7J how the orbit method works for 
the nilpotent group 5(?2, M) and small n. 

For general n G N the coadjoint action of the group G„ on g is as follows 

t = 1+ tkmEkm, y = ykmEkm, t ^ := 1+ '^km^km 

l<k<m<n l<m<k<n l<k<m<n 

hence 

q q n 

{tyt'^)pq = ^{ty)pmt;r^q = ^^tpryrmt^nq, ^ < P, Q < n, 
m=l m=l r=p 

and 

(2.16) Ad;{y) = {t-'yt)_ = I+ J] (rV)^,^?^- 

l<q<p<n 
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Example 2.7. Generic orbits for the group G = B{n,M.) {see |7], Example 7.9). 

"The form of the action AdJ'(y) = (t^^yt)- imphes, that Ad^, t E G acts as follows: 
to a given column of ?/ G g*, a linear combination of the previous columns is added and 
to a given row of ?/, a linear combination of the following rows is added. More generally, 
the minors A/;, k = 1,2, [^], consisting of the last k rows and first k columns of y 
are invariant of the action. It is possible to show that if all the numbers Ck are different 
from zeros, then the manifold given by the equation 

(2.17) Ak = Ck, l<k<^- 

is a G -orbit in q*. Hence generic orbits have codimension equal to [|] and dimension 
equal to — [|]. To obtain a representation for such an orbit, we can take a matrix 

y of the form 

where A is the matrix of order [^] such that all nonzero elements are contained in the 
anti- diagonal. It is easy to find a subalgebra of dimension [|] x [^^] subordinate to the 
functional y. It consist of all matrices of the form 

(OA) 
I J ' 

where A is an [f ] x [^] or [^] x [f ] matrix." 

Example 2.8. Let G = 5(5, M), g = n+(5,M), q* = n_(5,]R). We write the repre- 
sentations for generic orbit corresponding to the point y = y^iE^i + 2/42-^42 G Q* . Set 
[}s = {t — I \ t e H3} where 



1 xia a;i3 a;i4 xis \ A f / 1 ii4 tis \ ^ f / ° n n n n 

„ . , 1 X23 X24 X25 \ I ^ J / 1 i24 i25 \ I * J f n n n 

G = < \ 1 X34 X35 > , = < 1 i34 t35 > > = S 2^32 



1 a;45 / \ 1 / \ ^41 J/42 ^43 

1 / J ^> \ 1 / ^ \ ysi y52 y53 ysi , 

The corresponding representation S of the subgroup of the maximal dimension is: 

H-sBt^-^ exp{2ni{yXt -/))) = exp(27ri[ti5y5i + ^24^/42]) e S^. 

For the group i?(5,M) holds the following decomposition 

(2.18) B{5, R) = ^35(3)5(3) i.e. x = X3x{3)x^^\ 

where 

{/ 1 X12 xia o\ ^ f / 1 X14 \ ^ r /I 000 

/ 1 \ / 1 X24 2:25 \ n 1/01000 

00 1 n> , B{3) = n 1 X34 X35 M> , ^3 = <^ 1 
looolo/ Mooolo/ \000ix45 

\ooooi/J LVooooi/J Lvooooi 

We calculate h{x,t) in the relation s{x)t = h{x,t)s{xt), but first we fix the section 

s : X = H\G I— 7- G of the projection p : G ^ X. To define the section s : X h-> 

G we show that in addition to the decomposition fl2.18p the following decomposition 

B{5,R) = 5(3)535(3) also holds. Indeed, to find h e H3 = 5(3) such that x = hx^x^^\ 

we get X3x(3)x(3'' = hx3X^^\ hence 

(1 X14 xis \ /lOOO \ / 1 a;i4 a;i5-a;i4a;45 \ 

1 X24 a;25 \ / 1 \ / 1 X24 a;25-a;24a;45 \ ^.^s 

1 x34 a;35 1 = 1 0:34 0:35 -a;34a;45 €5(3). 

000 1 X45 / \ 0001 ~X45 / \ 1 / 

ooooi/Vooool/ Voooo 1 / 

We have two different decompositions 

535(3)5(3) 3 X3x(3)x(3) = /ix3x(3) G 5(3)535(3), with h = X3x{3)x^\ 



h{x,t) - I 
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Remark 2.9. For an arbitrary n, m E N, 1 < m < n, we have for the group Gn = 

B{n,M) two decompositions: 

(2.19) 

Gn = BmB{m)B^'^^ 3 x„x(m)x('") = /ix^x^™) G B{m)B^B^"^\ /i = x„x(m)x^\ 
where 

Bm = {1+ Yl ^kvEkr}, B{m) = {/+ XkrEkr}, B^""^ = {/+ ^ Xkr-Ekr}- 

m<k<r<n l<k<m<r<n l<k<r<m 

Since X = B{m)\Gn is isomorphic to BmB^"^^ by decomposition fl2.19p . the section s 
can be choosing, by Remark 12.11 as the embedding 

3 x„a;(™) ^ = x^x^"^) G B„,B{m)B^'^\ 

Since = h{x,t)s{xt), we have h{x,t) = s{x)t{s{xt))~^ . It remains to calculate 

s{x)t and s(a;t). 

Remark 2.10. We have 

0, /or t G 

/or teB{m) ' 

Indeed, let t = t^t^™) G then s{x)t = XmX^"'hmt^'^^ = XmtmX^"'H^"'l We get 

also xt = x.mx'^'^hmt'''^^ = XmtmX^^h'^'^\ SO s{xt) = XmtmX^"^H'--''^\ hence s{x)t = s{xt) 
and we get h{x, t) =e. For t := t{m) G B{m) and x = Xma;*-™-* G BmB{m) we get 

s(x)t = XmX^'^h = x^x(")t(x("))-ix(™) = x^x(m)x(") = /ix^x(") = /i(x,t)s(xt), 

where x{m) = x^"^h{x^"^^)~^ . Then we get by f l2.19p 

(2.21) hix,t) = (^'^ ,oJ (1 ^i^^-^r^ ^0^) = (i. ^ (1 ^ 
where 

(2.22) iy(x,t) :=x("^)(t-/)x„\ 

Denote by Ekr{t) := I+tE^r, t eM. the one-parameter subgroups of the groups B{n, M). 
We would like to find the generators Akn = ■§iTi^tEkJt=o of the induced representation 
Tt (1128]). 

Set for Gn =BmB{m)B^"'^ andl<k<m<r<n 
(2.23) 

Skritkr) ■■= {y, {h{x, Ekritkr)) " /)), then Akr = —exp{2mSkrit))\t=o = 27riS'fc^(l). 
Let us denote by S the following matrix: 

(2.24) § = {Skr)i<k<m<r<n, where Skr = Skr{l), then § = {27riy^{Akr)k,r- 

Lemma 2.11. Let B = (6fcr)fcr=i ^ Mat(n, C). Define the matrix G = {ckr)kr=i ^ 
Mat(n,C) by 

(2.25) Ckr = tT{EkrB), 1 < k,r < n, then we have G = B^ , 

where Ekr are matrix units and B^ means transposed matrix to the matrix B. The 
equality G = B^ holds also in the case when B is an arbitrary mxn rectangular matrix. 
The statement is true also for matrices B G Mat(oo, C). 
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Proof. Indeed, we have ii{Ek,fB) = Kk- D 

We calculate now the matrix §(t) = {Skritkr))k,r and the matrix S = {Skr{i))k,r using 
Lemma [2.111 Using f l2.22p we have 

{y, h{x, t)-I)= tr {H{x, t)y) = tr {x'^^'H^x;^ y) = tr (toX~^2/x('")) = tr {toB{x, y)) , 

where to = t — I and 

(2.26) Bix, y) = x-Jyx^-^ = (Lh) (Vo) { ? ) = ( .-.l^-) S ) • 

By definition we have 

Skrihr) = {y, ih{x, Ekr{tkr)) " I)) = tl{tkrEkrB (x, y)) , 

hence by Lemma [2 . 1 1 1 and (12.261) we conclude that 
(2.27) 

S = {Skrmr = {t.{EkrB{x,t))\^ = B^{x,y) = (x(™))V(a:-^)^ = ( o (^^^ ) 

So the induced representation Ind^(S') : G — )■ f/(L^(X, /i)) corresponding to the point 
y & Q* has the following form 

(2.28) iTJ)ix) = S{hix,t)) (^^Y)(xt), f e L\X,ft), xeX = H\G, t e G, 



djj,{x) 
where 

(2.29) S{h{x, t)) = exp(27ri(y, {h{x, t) - I))) = exp (^27ritr ((t - I)B{x, y)) ) . 
We calculate B{x,y) and S for different groups Gn- For G5 we get by (12.261) : 

{/ 1 xi2 a;i3 a:i4 115 \ ^ / \ 

/ 1 X23 a;24 xas \ / \ /I X12 ^13 \ / n 

Voo 1 / J \s/5i 0000/ 



B{x,y) = j 0) ^0 X23 = f ^45^2^51 ?/42+2.45Vl2^12 2/422:23+2:45^ ?/5ia;i3 



ysi yb\xi2 Vhix-iz 



-1. 



/I 00\/0 ^51 \ / — 1 \ / 4^ 

(2.30) §:=i?(x,?/) = (^;^12^1 (^2/42 j yl^'f j = ( ?/42+X4g^?;51X12 ?/5l2:i2 



hence by (12.271) we have 

1 q\ / ysi \ / , ( ""^fi 2/51 

|/42+a;45^?;5i2:i2 J/si^^i: 
l/42a::23+a;j5^?;5i2:i3 ?;5i2:i3 

Remark 2.12. For the matrix x = I + J2i<k<n<m ^knEkn £ B(m, M) we denote by x^^ 
the matrix elements of the matrix x~^ , i.e. x~^ =: I + J2i<k<n<m''^kn^kn £ -B(m,M). 
The explicit expressions for are as follows (see [8j, formula (4-4)) ^kk+i ~ ~^kk+i, 

n—k—l 

(2.31) -^kn ~ •^kn ~l" ^ ^ ( 1) ^ ^ XkiiXiii2- ■ ■•^ir'ni k <i Tl 1. 

r=l fc<ii<j2<...<ir<n 

The generators Akn = ■§iTj+tEkn\t=o of the one-parameter subgroups Eknit) := / + 
tEkni t G M generated by the representation Tt (I2.28P are as follows (see fl2.24p and 
(E30])): 

(2.32) Ai2 = /^i2, Ai3 = Di3, ^23 = Xi2/^i3 + /^23, ^45 = 1^45, 

1 / Ai4 Ai5 \ / ^« J/51 3/51 \ 

(2.33) S = - — : I A24 ^25 j = I J/42+a:Jg'^J/513::i2 ?;5l2l2 I , 

IWI \ A34 A35 J \ y^2X23+X^^y5lX,3 y^ixy, J 
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where Dkn = 75:7— • For example, to obtain the expression A23 = X12D1S + D23 we note 
that 

S(3,M) 9x(/ + t^23) = (0 1 .23j (^Olt j = (^0 1 X23+t 

Here we denote by D^n = D^nih) the operator of the partial derivative corresponding 
to the shift x ^ x + tE^n on the group Bm x i?'-'"-' 3 x = {xkn)k,n and the Haar measure 
h: 

1 /2 

(2.34) {DUh)f){x) = ^(^^^^±^] /(x + ti?,„)|,=o, DUh):-- ^ 



at \ ah[x) J oxkn 



Example 2.13. Let G = 5(4, R) = ^ I ^1" i^^g ) [■ ■ The representations for generic 

IVoo i/J 
orbit corresponding to the point y = y^sE^^ + 1/52 -E52 G g*. 

We calculate S in two different ways. First using (12.26^ we get 

B{x, y) = x^^'yx'^^'^ = {l^f) { yl ) ( ^" ) = ( ^If ^ ^«+;5r-^- 



( Z t)=^ = ^^(^' y) = UA){ vl ''0 ){xki^-^ '''''' 



y52 



2jj-j\A34A35J \ V 2:23 l^V J/43 U / \^a;45 ly V ?/43+a;r5'j/52a;'23 ^522^23 

^23 = -D23, ^45 = -D45- 

From the other hand, by fl2.2ip we get h{x, i) = {q ^^^'^^ ) , where 
(2.35) 

lJ(rf. t)=X^^Mt — I^X~^ = f 1 2:23 ^ (t24 t25 \ ( I Xjg^ \ = ( *24+a:23t34 (i24+a:23<34)x45^+i25+a:23t35 
^ ' ' ^ ' ' ) \0 I ) \ i34 ti4x2^+t25+t35 

Therefore, 

{y,{h{x,t)-I)) = h{x,t)34y43 + h{x,t)25y52 =t34y43+[ih4+X23t34)x4i+t25+X23t35]y52, 

hence 

g /-^N ._ f S24{t24) S'25(*25) \ _ f ^242:45 1/52 t25?/52 \ 

• 1^534(434) ^35(435) J \t34,y4,3+X2-it-i4,X~^ys2 X2stsby52 ) ' 

(2.36) §2 := §2(1) = ( I: §5 ) = ( 2/43+5/^X23 ^2X23 ) = ^ -23 1 ) ( J/L ''o' ) ( X.4t \ ) ' 

Example 2.14. LetG = 5(6, M), g = r;,+ (6,R), g* = n_(6,]R). VFe write the represen- 
tations for generic orbit corresponding to the point y = y43-E'43 + 2/52-^52 + VgiEgi G g*. 
Set 



1 xi2 xi3 xi4 xi5 xie \ \ f / I ti4 tis tie\ \ / 

1 X23 a;24 X25 X26 \ \ / 1 t24 t25 t26 \ / n n n n n n 

Q J I 1 X34 X35 X36 I if, = J 1 t34 t35 t36 K y = S 9. ± 9. 9. R 

1 1 X45 X46 f ' 1 1 ] ( ^ ° n n n 

000 1 x56 / VoOOOlO/ 10 2/52 0000 

0000 l/>' l.VoOOOOl/.' Vyei 00000, 

P)3 = {t — / I t G -ffs}. The corresponding representations S of the subgroup H3 is: 

ifs 3 exp(t - /) = t H-^ exp(27ri(y, (t - /))) = exp(27ri[t34y43 + ^25^/52 + ti62/6i]) G 5^ 
For the group 5(6, M) holds the following decomposition (see Remark 12. 9p 
(2.37) 5(6, M) = 535(3)5(3) i.e. x = X3x{3)x^^\ 



where 



X 



1 xi2 xi3 \ / 1 X14 X15 X16 \ / 1 

, 1 X23 \ / 1 X24 X25 X26 \ / 1 

(3) ^ 1 x(3) = 1 X34 X35 X36 Xc! = n n n ? ° ° 

1 0' •^^'^^ 1 ' -^3 1 x45 X46 

" 0010/ VoOOOlO/ \00001 x56 

0001/ \o 00001/ \000001 
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We get by fl2:26|) and (12:271) 

B{x,y) 



1 ^Ts 

1 




J/43 
2^52 
1/61 



1 2:12 Xi3 
1 X23 

1 



hence 



^46^3^61 ^A5y52+X^lyfi\Xi2 2/43+2^45^^522^23+2^46'^ 2^61^13 



y61 y52+2gg 1/61212 

S/61 yeixu 



B\x,y) 



10 
X'i2 1 
213 2:23 1 



?/52a;23+2;5g 3/6ia;i3 
J/61213 



J/61 
?/52 

yvA 





1 



y6i 

2^5^ J/52+2 Jg^y612;i2 



256 

«/52+2^g^1/612i2 
-1. 




J/43+245 J/52223+2;4g J/61213 J/52223+2gg J/61213 J/61213 

Using again fl2.24p . f l2.28p and Remark 12.101 we get the following expressions for 



generators Akn 

(2.38) 
(2.39) 

(2.40) ^ 



jlTi+tEkJ\t=o of one-parameter subgroups / + tEkn, t G 



Ai2 ■- 

A45 



13 



-D455 ^46 



^13, 
- -D46, 



A23 = a;i2^i3 + D23, 
A^e = + Dse, 



1 / Ai4 Ai5 Aig 
^24 ^25 ^26 

2m \ A34 A35 Asa 



2^6^ J/61 2gg^J/61 
2j5^J/52+2jg^J/612l2 J/52+2gg^J/612;i2 J/61212 

J/43+24g^J/52223+2;4g^J/612l3 J/52a;23+2:gg^J/6ia;i3 J/61213 



We recall the expressions for B{x, y) and hence for § = -B(x, yY for small n. For n 
we have 



y) = X- = ( ; f ) ( ) ( T 



XA^yS,2 J/43 +24g-'"J/52 223 



"45 
J/52 



'•45 ■ 
2/52223 



. 22: 



1 W J/52 N 

23 1 M J/43 ) 



1 

.-1 1 



For ~ 5(6, M) (see (IXiTj) for the notation G\ 



24g J/52 1/52 
J/43 +24g-'" J/52 223 J/52223 

I holds: 



B{x,y) 



1 


■^45 


^46 





1 


■^56 








1 



J/43 
J/52 
J/61 



1 212 213 
1 223 

1 



hence 



24g^J/61 24g^J/g2+24g^J/6l2i2 J/43+24g^J/52223+24g^ J/61213 

^SeVei ?/52+2^g^J/6l2l2 J/52223+25g^J/6l2l3 
J/61 J/61212 J/61213 



2/1 



-1. 



-1. 



56 2^61 
-1. 



J/61 



"46 ysi 

2j5^J/52+2jg^J/6l2l2 J/52 +2;5g" J/61 212 J/6l2l2 

J/43+245^J/52223+24g^ J/61213 J/52223 +2jg^ J/61213 J/61213 ^ 



1 0\ / J/61 

212 10 J/52 

213 223 1 / V J/43 



For Gl - 5(8, 



holds: 



1 





1 







201 

1 





202 
212 

1 




203 

a;i3 
2:23 
1 


io4 

tl4 
^24 
t34 


io5 

tl5 
t25 
t35 


i06 
*16 
i26 
*36 


t07 

tn 

t27 
t37 














1 


2^45 


246 


247 

















1 


^56 


^57 


1° 

















1 


267 


\0 




















1 



■ 







. J/70 










J/61 











J/52 






0\ 

\ 





J/43 
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As before we have 



1 










■^46 


^47 





1 


^56 


^57 








1 


^67 











1 



y43 

J/52 

J/61 

.J/70 



1 XQl X02 ' 

1 Xi2 Xis 

1 a:23 ' ' 

1 



10 

XQi 10 

X02 Xi2 1 

X03 Xi3 X23 1 



J/70 

yei 

J/52 

J/43 




1 











45 


1 








46 


^56 


1 











1 


47 


^57 


^67 



2.4. New proof of the irreducibihty of the induced representations corre- 
sponding to a generic orbits. 

Remark 2.15. By Kirillov's Theorem \2.5\ the induced representation Tf^n = Ind^f^/.H 
is irreducible if and only if the Lie algebra f) of the group H is a subalgebra of q subor- 
dinate to the functional f with maximal possible dimension. 

The condition of "maximal possible dimension" is difficult to extend for the infinite- 
dimensional case. That is why in this section we give another proof of the irreducibility 
of the induced representation of a nilpotent group B{n,M.) that will be extended in Sec- 
tion \3.^ for the infinite- dimensional analog Bq of the group B{n,M.). 

Let us consider a sequence of a Lie groups and its Lie algebras g^, m G Z, n G N 
defined as follows 

(2.41) G':={I+ Yl ^kuEkn}, S:r = { Yl ^kuEun}. 

m—n<.k<n<.m+n+l m—n<k<n<m+n+l 

We note that for any m G N holds B^ = G^. We have the decomposition (see 

O) 



where 



Bm,n = {I+ Y XkrEkr}, B{m,n) = {I + ^ Xfc^^fcr}, 
{k,r)eAm,n (fc,r)eA(»n,n) 



and 



A(m, n) = {{k, r) E 7? \ m — n < k < m < r < m -\- n -\- 1} , 
^m,n = {(A;, r) G \ m + l<k<r<m + n + l}, 
^{m,n) = {(^k,r) e Z"^ \ m - n < k < r < m}. 
The corresponding elements of the group follows 



/ 1 ^m — n,m — n+l 

' 1 



Xm, — n,,m—l Xm,-~n,m ^m — n,m+l ^m — ri,m-|-2 



Xm,~l,m im — l,m-\-l ^m — l,m + 2 

1 ^m,m 4-1 ^m,m+2 

1 + + 2 

1 



^m — n,m + ri-|~l \ 
irn, — n-\'l,7n-\-rL-\-l 

^ m — 1 , m + ri + 1 
tm,,m-\-n--\-l 
+ 1 , + ^^+ 1 
+ 2 , m -|-ri + 1 

^ m+ Ji , m+ 'T' + 1 

1 
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The induced representation of the group is defined in the space L'^{X,dfj,) by the 

following formula 

(2.42) 

iTr'"f)ix) = S{h{x,t)) fM^\ f(^^t), f e L2(X,/i), xEX = H\G, t E G 

\ aij,[x) J 

where X = B{m,n)\G'^ ^ x E^"'") (see ([Ml)), 

(2.43) (i/i(x„, x^")) = dxm ® rfx^™) = ®(fc,n)GA„,„c?a;fc„ ® ®(fc,„)gA(->")C?a;fc„ 

be the Haar measure on the group -Bm,n x B^'^'"-\ Denote by 7^™'" = L'^(Bm,n x 
S(™''^),dx„®c/x(™)). 

Theorem 2.16. The induced representation T™'^" of the group defined by formula 
I!i2.4^ , corresponding to generic orbit Oy^, generated by the point ?/„ G (0™)*, 
yn = ^"=0 ym+r+i,m-rEm+r+i,m-r is irrcduciblc. Morcovcr the generators of one-parameter 
groups Akr = ji'^^tEkr l*=o "'^^ as follows 

fc-1 fc-1 
^fcr = ^ ^ XksDrs ~\~ Djf^r, {k,r) G A'^ ' A/jj. = ^ ^ XksDr-s ~\~ Dj,^, {k,r) G Am^„, 

s=m—n s=m+l 

(27rz)-i(A,,)(^_^^^^(^_^^ = = (5,,)(,,,)eA(^,„) = {x-V-'Y- 

The irreducibility of the induced representation of the group is based on the 
following lemma. 

Lemma 2.17. Two von Neumann algebra 21'^ and 21^ in the space Ji"^'^ generated 
respectively by the sets of unitary operators Ukr{t) and Vkr{t) coincides, where 

(2.44) {Ukrit)f)ix) = exp{2mSkr{t))f{x), (Vfc,(t)/)(a;) := expi2mtxkr)f{x), 
21^ = {Ukrit) = TPJ^^^ = exp(27rz5fc,(t)) | t G M, (A;,r) G A(m,n))", 

21" = (VUt) ■■= exp{2mtxkr) \teR, {k,r) G A„,„ |J A^"^'"))". 
Proof. Using the decomposition (see (12.261) and (12.271) ) 

(2.45) S^) = (x-^yx(-))^ = {x^-ry^{x-^r 

we conclude that 21"^ C 21^. Indeed, we get Vkrif) := exp(27rztxfcr) £ 21^ hence the 
operators x^r of multiplication by the independent variable /(x) ^ Xkrf{x) in the 
space "H™'"" are affiliated with the von Neumann algebra 21^ i.e. Xkr V 21^ for {k, r) G 
A I I A(™'") 

Definition 2.18. Recall {c.f. e.g. [3J) that a non necessarily bounded self-adjoint op- 
erator A in a Hilbert space H is said to be affiliated with a von Neumann algebra M 
of operators in this Hilbert space H, if exp{itA) G M for all t G M. One then writes 
Ar] M. 

By (I2.3ip the matrix elements x')^^ of the matrix G -Bm.n are also affiliated 



X 



kr 



} 7] 21^. Using (I2.45P we conclude that the matrix elements Skr, G A(m,n) of the 



matrix si'"'* are affihated: Skr V 2t^, {k,r) G A(m,n), so 21'^ C 21^. 

To prove that 21'^ D 21^ we find the expressions of the matrix element of the ma- 
trix x*^™-* G and G Bm,n in terms of the matrix elements of the matrix 
SrT'' = {Skr){k,r)£A{m,n)- To do that wc couucct the abovc decomposition si™"* = 
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{x'^'^^Y' {x^Y ^'^d the Gaussian decomposition C = LDU (see Theorem 14. ip . Let us 
denote by J the n x n anti-diagonal matrix J = J2r=o Em~r,m+r+i Using J"^ = I and 
(12:271) we get 

(2.46) §J = B^{x,y)J = (a;(-)) V(x-^)^ J = {x^^Y iv^ JKA^-T J) ■ 

The latter decomposition (12.461) is in fact the Gauss decomposition of the matrix SJ i.e. 
we get 

§J = LDU, where L = {x^'^Y, D = y'^J, U = Jix'lYJ. 
Using the Theorem 14. II we can find the matrix elements of the matrix x^"*^ G and 
e Bm,n in terms of the matrix elements of the matrix §1"^^ hence we can also find 
the matrix elements of the matrix Xm G -Bm,n- This finish the proof of the lemma. □ 

We give below the expressions for S„J. For m = 3 and n = 1 i.e. for G\ we have 
(remind that J"^ = I ) 

S — ( 1 W y-,2\ ( 1 \ _ / 1 W 2/52 \ ( xj} 1 
»2 - U23 1 U y43 j 1 j - U23 1 U yiz)\ \' 

S2j=(4?)(i%«)(;f 



For G\ we get 



/I \ / ?/61 \ / X^gl Xggl 1 ~ 

S3 = X12 1 j;52 -1 1 

V 2-'13 1'23 1 / V 1/43 / \ f 0. 



For G\ we have 



1 

§3J = X12 1 
V a;i3 a;23 1 



1 00\/?/7o0 
xoi 1 W ?/6i 












^56 ^46 \ 


) (T 


?/52 


° ) 


(" 


1 -4^ 







y43 / 


Vo 


1 / 



a:o2 a:i2 1 I I 1/52 
a;o3 a;i3 X23 1 / \ 1/43 



/ 1 










/ ?/70 








/ a;oi 


1 







(° 







1 a;o2 




1 










1/52 


\ a;03 


X\3 


I.'23 




V 










(2.47) §4^ 

Proof, of the Theorem \2.1(A The irreducibility follows from the Kirillov results (see 
Remark I2.15P . To give another proof of the irreducibility of the induced representation 
consider the restriction T"^'^" \B{m,n) of this representation to the commutative subgroup 
B{m,n) of the group G^. Note that 

21^ = (exp(27ritxfe,) | t G M, {k,r) G A„,„ |J A^'"'"))" = L°°(5^,„xS('^''^), dx^^rfx^'")). 

By Lemma 12.171 the von Neumann algebra 21"^ generated by this restriction coincides 
with (E^,„ X , dx^ ® dx^""^ ) . Let now a bounded operator A in a Hilbert space 

^m,n commute with the representation T™'^" . Then A commute by the above arguments 
with L°°{Bm.n X B^^'"'\ dxm ® dx^"^^), therefore the operator A itself is an operator of 
multiplication by some essentially bounded function a G L°° i.e. {Af){x) = a{x)f{x) 
for / G Ti^'^. Since A commute with the representation T"*'^" i.e. [A,TJ^'^"] = for all 
t G Bm,n X i?*^™-'"^ we conclude that 

a{x) = a{xt) (mod dxm ® dx'-"'^) for all t G Bm,n x 5^""'"^ 
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Since the measure dh = dxm ® rfx^"^-* is the Haar measure on G = B„i,n x this 
measure is G-right ergodic. We conclude that a{x) = const (mod 

3. Induced representations, infinite-dimensional case 

3.1. Regular and quasiregular representations of infinite-dimensional groups. 

To define the induced representation we explain first how to define the regular represen- 
tation of infinite- dimensional group G. Since the initial group in not locally compact 
there is neither Haar (invariant) measure on G (Weil, [H]), nor a G-quasi-invariant mea- 
sure (Xia Dao-Xing, [I9]). We can try to find some bigger topological group G and the 
G-quasi-invariant measure /i on G such that G is the dense subgroup in G. In this case 
we define the right or left regular representation of the group G in the space L'^{G, fx) if 
/i^' ~ fi (resp. yU-^' ~ fi) for alH G G as follows: 

(3.1) (T,^''^/)(x) = idfiixt)/df,{x)y/'fixt), f e L2(G,/i), t e G, 

(3.2) (Tl^'^mx) = idfiit-'x)/dfiix)y/'fit-'x), f e L\G,fi), t e G. 

Conjecture 3.1 (Ismagilov, 1985). The right regular representation T^'^^ : G — )■ U{L'^{G,fi)) 
is irreducible if and only if 

1) fi^* ±fiWte G\{e}, 

2) the measure fi is G- ergodic. 

Analogously we can define the quasiregular representation. Namely, if if is a closed 
subgroup of the group G, then on the space X = H\G = H\G the right action of 
the group G is well defined, where G (resp. H) is some completion of the group G 
(resp. H). If we have some G-right-quasi-invariant measure /i on X one may define 
the "quasiregular representation" of the group G in the space L^(X, /z) as in a locally 
compact case: 

(Trf '''^/)(x) = {dfi{xt)/dfi{x)Y/^f{xt), t e G. 

The regular and quasiregular representations for general infinite-dimensional groups 
were introduced and investigated in e.g. [H [9l [101 IHl [13] . 

3.2. Induced representations for infinite-dimensional groups. The induced rep- 
resentation Indus' of a locally-compact group is the unitary representation of the group 
G associated with a unitary representation S* of a subgroup H of the group G (see 
Section [2]). 

As it was mentioned in section [221 (see [H[7]) all unitary irreducible representations 
up to equivalence G„ of the nilpotent group Gn = -B(ra,]R), are obtained as induced 
representations Ind^"f//_H associated with a points / G 0* and the corresponding subor- 
dinate subgroup H C Gn- The induced representation Ind'^^Uj^H is defined canonically 
in the Hilbert space L'^{H\Gn, fJ^)- 

A. Kirillov |7j. Chapter I, §4, p. 10 says: "The method of induced representations is not 
directly applicable to infinite- dimensional groups (or more precisely to a pair G D H) 
with an infinite- dimensional factor H\G )" . 

Our aim is to develop the concept of induced representations for infinite- dimensional 
groups. Let we have the infinite-dimensional group G and a unitary representation 
S : H ^ U(y) in a Hilbert space \^ of a subgroup H of the group G such that the 
factor space H\G is infinite-dimensional. 
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In general, it is difficult to construct G-quasi-invariant measure on an infinite-dimensional 
homogeneous space H\G. As is the case of the regular and quasiregular representations 
of infinite-dimensional groups G (see Subsection 13. ip it is reasonable to construct some 

G-quasi-invariant measure on a suitable completion H\G = H\G of the initial space 
H\G in a certain topology, where H (resp. G) is some completion of the group H (resp. 
G). To go further we should be able to extend the representation S : H ^ U{V) of the 
group H to the representation S : H ^ U {V) of the completion H of the group H. 

Finally, the induced representation of the group G associated with a unitary represen- 
tation S" of a subgroup H will depend on two completions H and G of the subgroup H and 
the group G, on an extension S : H ^ U {V) of the representation S : H U (V) and 
on a choice of the G-quasi-invariant measure fj, on an appropriate completion X = H\G 
of the space H\G. 

Hence the procedure of induction will not be unique but nevertheless well-defined (if 

a G-quasi- invariant measure on H\G exists). So the uniquely defined induced repre- 
sentation Indus' in the Hilbert space L'^{H\G,V, fi) (in the case of a locally-compact 
group G) should be replaced by the family of induced representations Ind^''^'^(5', S) in 

the Hilbert spaces L'^{H\G, V, fi) depending on different completions G of the group G, 
completions H of the group H and different G-quasi-invariant measures fi on H\G. 

Example 3.2 ([HI [11]). Regular representations T^'^^ of the infinite- dimensional group 
G in the space L^(G,/i), associated with the completion G of the group G and a G-right 
-quasi-invariant measure fj, on G, is a particular case of the induced representation (see 
Remark\23i) 

generated by the trivial representation S = Id of the trivial subgroup H = {e} (as in the 
case of a locally compact groups). 

Example 3.3 ([Il|13]). Quasi-regular representations tt^'^'^ of the infinite- dimensional 
group G in the space L'^{X, /x) where X = H\G and H is some subgroup of the group G 
is a particular case of the induced representation (see Remark IK^) 

generated by the trivial representation S = Id of the completion H in the group G of 
the subgroup H in the group G. 

Let G be an infinite-dimensional group and S : H ^ UiV) be a unitary representation 
in a Hilbert space V of the subgroup H G G, such that the space II\G is infinite- 
dimensional. We give the following definition. 

Definition 3.4. The induced representation 

Ind|5'^(^,^), 

generated by the unitary representations S : H ^ U (V) of the subgroup H in the group 
G is defined (similarly to liS. 2) and hS. 3\) ) as follows: 

1) we should first find some completion H of the group H such that 

S:H^ UiV) 

is the continuous unitary representation of the group H , such that S\h = S, 
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2) take any G -right- quasi-invariant measure /i on the an appropriate completion X — 
H\G of the space X — H\G, on which the group G acts from the right, where H (resp. 
G) is a suitable completion of the group H (resp. G), 

3) in the space L'^{X ,V, /i) of all vector-valued functions f on X with values in V 
such that 



(TJ){x) = S{h{x,t)) {^^y f{xt), xeX^teG, 



define the representation of the group G by the following formula 
(3.3) 

where h is defined by 

s{x)t — h{x,t)s{xt). 

The section s : H ^ G of the projection p : G ^ H should be extended to the appropriate 
section s : H ^ G of the extended projection p : G ^ H. 

The comparison of the induced representation for locally compact group and the above 
definition for infinite-dimensional groups may be given in the following table: 



1 


G 


G loc.comp. 


dim G = oo 


2 


H 


H gG 


H gG 


3 


S 


S U{V) 


S : H ^ U{V) ^ S : H ^ 
U{V) 


4 


X 


X = H\G 


X = H\G = H\G 


5 


n 


L\X = H\G,V,ii) 


L2(X = H\G,V,fjL) 


6 


Ind 




lndg'5^(5,5) 


7 


Tt 


iTtf){x) 

siHx,t)r^y/'f{xt) 


mf){x) 

sCh{x,t)r^y/'f{xt) 


8 


P 


p:G^X 


p:G^X 


9 


s 


s:X^G 


s : H\G -^G^s: H\G 
G 


10 


h{x, t 


s{x)t = h{x, t)s{xt) 


s{x)t = h{x, t)s{xt) 



3.3. How to develop the orbit method for infinite-dimensional "nilpotent" 
group i?Q and B^? We would like to develop the orbit method for infinite- dimensional 
"nilpotent" group G — lir^^Gn with Gn — -B(n, R). The corresponding Lie algebra g 
is the inductive limit Q — lii^^ b„ of upper triangular matrices, so as the linear space 
it is isomorphic to the space M[f of finite sequences {xk)keN hence the dual space g* is 
isomorphic to the space ]R°° of all sequences {xk)keN, but the latter space is too large 
to manage with it, for example to equip with a Hilbert structure or to describe all orbits. 
To make it less it is reasonable to increase the initial group G or to make completion G 
of this group in some stronger topology. 

To develop the orbit method for groups and Bq we should answer some questions: 

(1) How to define the appropriate completion G of the group G, corresponding Lie 
algebras g (resp. g) and corresponding dual spaces g* (resp.g*)? 

(2) Which pairing should we use between g and g*? 
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(3) Let the dual space q*, some element / G g* and corresponding algebra f), subor- 
dinate to the element /, are chosen. How to define the corresponding induced represen- 
tation IndffUf^H and study its irreducihility ? 

(4) Shall we get all irreducible representations of the corresponding groups, using 
induced representations? 

(5) Find the criteria of irreducibility and equivalence of induced representations. 
The problem of completion of the inductive limit group G = lin^ G„, where Gn 

are finite-dimensional classical groups were studied by A. Kirillov ([5j, 1972) for the 
group U{oo) = lii^^f/(n) and G. 01shanskii([16j. 1990) for inductive limit of classical 
groups. They described all unitary irreducible representations of the corresponding 
groups G = lu^^Gn, continuous in stronger topology, namely in the strong operator 

topology. The description of the dual G of the initial group G = lii^^ G„ is much more 
complicated. 

In ^ (see details in section [231) we have constructed for the group GLo(2oo,]R) 
= lii^ GL(2n — 1, M) a family of the Hilbert-Lie groups GL2(a), a G 21 such that 

a) GLo(2oo,M) C GL2(a) and GLo(2oo,M) is dense in GL2(a) for all a G 2t, 

b) GLo(2oo,M) = n,es^tGL2(a), 

c) any continuous representation of the group GLo(2oo, M) is in fact continuous in some 
stronger topology, namely in a topology of a suitable Hilbert -Lie group GL2(a). 

(1) Therefore, as we show in Sections 13.51 13.41 it is sufficient to consider a Hilbert-Lie 
completions -82(0) of the initial group B^. 

(2) In this case the pairing between the corresponding Hilbert-Lie algebra b2(a) and 
its dual 62(0)* is correctly defined by the trace (as in the finite-dimensional case). 

(3.1) We define in Section [XT] t/ie induced representations of the group correspond- 
ing to a special orbits, generic orbits, using schema given in Section 13. 2[ We consider 
only the simplest example of G— quasi-invariant measures on X = H \ G, namely the 
infinite product of one-dimensional Gaussian measures. 

(3.2) How to construct the induced representation corresponding to an arbitrary orbitl 

Conjecture 3.5. Two induced representations Ind'^'^^Uf-^^Hi one? Ind^|^^^?7/2,H2 are equiv- 
alent if and only if the corresponding measures /xi and ^2 are equivalent and the func- 
tionals fi and /2 belong to the same orbit of (0)*. 

3.4. Hilbert-Lie groups GL2(a). We show that the Hilbert-Lie groups appear natu- 
rally in the representation theory of infinite-dimensional matrix group. The remarkable 
fact is that for the inductive limit G = lu^ Gn of matrix groups Gn C GL(2n — 1,M) 
it is sufficient to consider only the Hilbert completions of the initial group G and of the 
spaces H\G. 

Let us consider the group GLo(2oo,M) = lim^ GL(2n — 1,M) with respect to the 
symmetric embedding i^ : Gn ^ Gn+i, Gn 3 x x -\- i?_„ _„ + Enn G Gn+i, where 
Gn = GL(2n — 1,M). We consider here only the real matrices. 

The Hilbert-Lie group GL2(a) we define (see [S]) by its Hilbert-Lie algebra Qhia) with 
composition [x, y] = xy — yx 

Qk{a) = {x = ^ XknEkn I ||a;||g/2(a) = ^ l^kn r (^kn < oo}, a G SIgl, 



GL2(a) = {I + x I (/ + x)-^ = l + y x,y e Qhia)}. 
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To be more precise, let us consider an analogue o"2(a) of the algebra of the Hilbert- 
Schmidt operators cr2{H) in a Hilbert space H: 

0-2(0) = {X = ^ XknEkn I Ik||a2(a) = ^ \ ^kn \^ Clkn < Oo] . 

Lemma 3.6 ([!])• The Hilbert space 0"2(a) is an (associative) Hilbert algebra (i.e. 
\\xy\\ < ||?/||, x,y G cr2{a)) if and only if the weight a = {akn){k,n)€Z'^ belongs to 

the set 21gl defined as follows: 

(3.4) SIgl = {a= {akn){k,n)ei? I < afe„ < Cakmamn, k,n,m e Z, C > 0}. 

We define the Hilbert-Lie algebra 0/2(0) as the Hilbert space (12(0) with an operation 
[x, y]= xy- yx. 

Corollary 3.7. The Hilbert space 0/2(0) is a Hilbert-Lie algebra if and only if the weight 
a = {akn){k,n)&^ belongs to the set 21gl- 

We remark also [8] that GLo(2oo,]R) = nagaGLGrL2(a). 

Theorem 3.8 (Theorem 6.1 [8J). Every continuous unitary representation U of the 
group GLo(2cx3,M) in a Hilbert space H can be extended by continuity to a unitary 
representation 1/2(0,) : GL2(a) — > U{H) of some Hilbert-Lie group GL2(ci) depending on 
the representation. 

3.5. Hilbert-Lie groups 52(0-). Let us consider the following Hilbert-Lie group i?2(o) : = 
5f(a) 

(3.5) 52(a) = {I + x I X G b2(a)}, 

where the corresponding Hilbert-Lie algebra b2(a.) := b|(a) is defined as 

(3.6) b2(a) = {x= ^ XknEkn I ||a;||b2(a) = X] \xkn ? akn < 00}. 

{k,n)<^'I? ,k<n {k,n)GZ'^ ,k<n 

Lemma 3.9 ([8]). The Hilbert space b2{a) (with an operation {x,y) t— )■ xy) is a Banach 
algebra if and only if the weight a = {akn){k,n)ez^,k<n satisfies the conditions 

(3.7) a = {akn)k<n, a-kn < Cokmamn, k <Tn<n, k,m,n eZ. 
Denote by 21 the set of all weight a satisfying the mentioned condition. 

3.6. Orbit method for infinite-dimensional "nilpotent" group Bq, first steps. 

Take the group Bq, fix some its Hilbert completion i.e. a Hilbert-Lie group B2{a), a G 21 
and the corresponding Hilbert-Lie algebra = b2(a). The corresponding dual space 
0* = b2(a) has the form 

(3.8) b;(a) = {y= ^ yknEkn I \\y\\^ia) = Yl ' ^-^^ "fc" < 

(fc,7i)gZ2,fc>n {k,n)eZ^,k>n 

The adjoint action B2{a) — )■ Aut(b2(a)) of the group -82(0.) on its Lie algebra b2(a) is: 

(3.9) b2(a) 3 X ^ Adt{x) := txt'^ G b2(a), t G ^2(0). 

The pairing between = b2(a) and 0* = b2(a) is correctly defined by the trace: 

(3.10) 0* X 9 (y,x) (y,x) := tr(x?/) = ^ XknVnke^- 

{k,n)&I?,k<n 
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The coadjoint action of the group B2{a) on the dual q* = b2{a) to = 62(0) is as follows: 
for t e B2{x) and y e 62(0) 

t = I+ 

(fc,n)eZ2,fc<n {k,n)eZ'^,k>n {k,n)eZ^,k<n 

we have 

q q 00 

{t'^yt)pq = Yl it'^y)pmtmq = YtprVrmtrnq, {p, Q) G ^ > q, 

m=— 00 m=—oo r=p 

hence 

(3.11) Adliy) = it-'yt). := I + {t-'yt),,E,,. 

(p,(j)ez2,p>g 

We consider four different type of orbits with respect to the coadjoint action of the 
group -82(0) in the dual space 62(0). 

Case 1 ) The finite- dimensional orbits corresponding to a finite points y = 
Tli{kn)&k>nyknEkn £ &2(^) (finiteness of y means that only finite number of ykn are 
nonzero). This orbits leads to the induced representations of an appropriate finite- 
dimensional groups G™, m G Z, G N defined by (12.411) . All irreducible unitary 
representations of the groups are completely described by the Kirillov orbit method 

hence the finite-dimensional orbits gives us the set UneN ^ -^0 (^^^ subsection 13.91 
Remark EUT] for embedding C G^i)- 
Case 2) {]- dimensional orbits are of the form: 



Oo = y, ye 62(0), y = Yyk+i,kEk+i,k- 



The Lie algebra 62(0) is subordinate to the functional y, {y, [62(0), b2{a)]) = since 

[62(0), 62(0)] = {X e b2{a) \ X = ^ XknEkn}- 

(/c,n)eZ2,fc+l<n 

The one- dimensional representation of the Lie algebra 62(0) are 

62(0) 3 X i-)- {y,x) = ^ Xfc,fc+il/fc+i,fc G M. 

kez 

Corresponding one-dimensional representations of the group B2{a) are as follows: 
(3.12) 52(a) 3 exp(x) f-^ exp{2m{{y,x))) = exp{27ri'Yxk,k+iyk+i,k) G S^. 

They are all irreducible and nonequivalent ior different y = '^k^^yk+i,kEk+i,k G b2{a). 
Case 3) Ceneric orbit is generated for an arbitrary m G Z by a point y G b2{a) 



00 



(3.13) y = y^^ym+p+i,m-pEm+p+i,m~p G b*2{a), with ym+p+i,m~-p ^ 0, P+ I eN. 

p=0 

Sections 13.71 and IXSl are devoted to the study of this case. 

Case 4) Ceneral orbits generated by an arbitrary non finite points 

y = 5Z y^nEkn G b*2{a). 

(k,n)€Z,k>n 
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Problem. How to construct the induced representations for general orbits and study 
their irreducibility? 

3.7. Construction of the induced representations of the group correspond- 
ing to a generic orbits. Consider more carefully the case 3). The irreducibility we 
shall study in the following subsection. Take as before the group Bq, fix some its Hilbert 
completion i.e. a Hilbert-Lie group -82(0), a G 21, the corresponding Hilbert-Lie algebra 
= b2(a) and its dual g* = b2(a) as in the previous subsection. 

We shall write the analog of the induced representation of the group Bq for generic 
orbits (see Examples 12.71 [2^ and [2?T^ corresponding to the point y G b2(a) defined by 
(Km following steps l)-3) of Definition [331 

Step 1) Extension of the representation S : H ^ UiV). For fixed m E Z, consider 
the decomposition 

B^ = BrnB{m)B^'^^ 
similar to the decomposition 02.191) . where B'^ = {I + '^k,nez,k<n^knEkn}, 

Bra = {/+ Yl ^krEkr}, B{m) = {/+ ^ XkrEkr}, B^""^ = {/+ ^ Xfc^^fcr}, 
(fc,r)eA™ (fc,r)eA(m) (fc,r)GA('") 

Am = {{k,r) e Z'^ \ m + 1 < k < r}, A(m) = {{k,r) e \ k < m < r}, 
and A^™) = {(fc,r) eZ^ \ k <r <m}. 

Since the algebras i)Q{m), m G Z defined as follows l)o{m) = {t — I \ t E Bo^m)}, 
where Bo{m) = B{m) fl Bq, are commutative, so (y, [f)o(m), fio(m)]) = 0, hence they 
are subordinate to the functional y E Q* = b2(a). The corresponding one- dimensional 
representation of the algebra f)o("^) = [)(?^) flSo 

00 

{)o(m) 3 X h-^ (y, x) = ^ 

•^m—p.m+p+iym+p+l^m'-p G 

The unitary representation of the corresponding group Ho{m) is 

HQ^m) 3 exp(s) 5'(exp(x)) = exp{27ii{y,x)) G S-^. 

This representation can be extended to representation of the corresponding Hilbert-Lie 
group H = H2{m, a) = B{m) -82(0) (we note that t = exp(t — 1)): 

H2{m,a) 3 exp(x) i-> S'(exp(x)) = exp(27ri(?/, x)) G S^. 

In what follows we shall use a notation B2{m, a) for the group H2{m, a). 

Step 2 a) Construction of the completion X = H\G of the space X = H\G. It is 
difficult to construct an appropriate measure on the space X^fi = Bo{m)\BQ since it is 
isomorphic to the space M.^ C M^. That is why we consider two homogeneous spaces, 
an appropriate completions of the space Xm,o'- 

Xm,2ia) = S„,2(a)\S2(a), X^ = B{m)\B^. 
Since the decompositions holds 

B^ = Bm,oBo{m)B^"'\ ^2(0) = BmMB2{m, a)4" V), B^ = BmB{m)B^^\ 
(see Remark [2.91) . we have the following inclusions: X^q C Xm,2{.o) C X^, where 
Xmfi ^ 5^,0 X b'^^\ X^,2(a) ~ S^,2(a) x sfV), = B{m)\B^ ~ B^ x B^'''\ 

Step 2 b) We construct a measure fib on the space Xm with support Xm,2{(i) i-e. such 
that fib{Xm,2{0')) = 1- That is we take X = H\G = B2{m,a)\B2{a). 
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Remark 3.10. On the space we can take any - quasi-invariant ergodic measure, 
construct the induced representation and study the irreducibility. We consider the sim- 
plest case of the Gaussian measure, the infinite product of one- dimensional Gaussian 
measure. 

We construct the measure fib on the space — -B-m x as a product-measure 
fJ'b = /^6,m ® /^["^^ where /j^b^m (resp. ^j^b"^) is Gaussian product measure on the group 
Bm (resp. B^™-^) defined as follows: 



(3.14) dfib,m{Xm) = <S)(k,n)eAmdf^bk„{Xkn) = ®(fc,n)eA„ \l ^ exp{-bknxUdXkn, 



(3.15) dll^^\x^'^'^) = ®^k^n-)^^{ru)dlJ,b^^{Xkn)=®{^k,n)&A^^^^ 

The corresponding Hilbert space is 

= L2(X^,/x,) = L\B^ X ^(™)). 

Lemma 3.11 (Kolmogorov's zero-one law, pJZj)- We have idb,m®l^b^\Bm,2{(^)^B2^\a)) - 
1 if and only if 

y ^ — < cx). 

(fc,n)GA(m)uA{'") 

Lemma 3.12 (^ HH])- T/ie measure jib = l^b,m ® l^t^^ is -Bm,o x B^"^ -right- quasi- 
invariant i.e. (i^b)^^ ~ A^b /o?^ i G -Bm,o x -Bq™'' ^/ ^'^^ ^^^^2/ ^/ 

'^knil^b) = 22 ^ ■^^'^ k < n <m. 

r=-oo ^'^ 

Step 3) The corresponding induced representation of the group Bq we defined as 
follows: 

(3.16) iTrf)ix) = SiHx^t)) f{xt), xeXm^teG, 

where (see fl3.2ip ) 

S{h{x, t)) = exp{2m{y, h{x, t) - 1)) = exp (2mtr {{t - I)B{x, y)) ) . 



3.8. Irreducibility of the induced representations of the group B^ correspond- 
ing to a generic orbits. Consider the induced representation T^'^ of the group Bq 
corresponding to a generic orbit Oy, generated by the point 
y = Y,T=oy-m+r+i,m-rEm+r+i,m-r ^ ^^(a) defined by p.iep. Set for {k,r) e A(m) 

(3.17) ^ 

Skrihr) ■= {y, {h{x,Ekr{tkr)) " /)), then Akr = --exp{27riSkrit))\t=o = 27riSkril)- 

dt 

Let us denote by S*^™-* = S the following matrix (compare with fl2.23p and fl2.24p ): 

(3.18) S = (5'A;r)(fc,r)eA(m), whcrC Skr = Skr{'^). 

We calculate now the matrix S(t) = (5'fcr(tfcr))(A:,r)eA(m) and the matrix § = 
(S'fcr(l))(A:,r)GA(m) usiug aualog of the Lemma [2.111 As in fl2.22p we have 

(y, h{x, t)-I)= tr {H{x, t)y) = tr {x^'^HoxZ^y) = tr (tox-^yx^'")) = tr {toB{x, y)) , 
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where to = t — I and for Xm G B^i, x^"^^ G B^"^^ we denote 
(3.19) B{x,y)=x-Jyx^-^ = ( ( ^ ( ?) = (.-.V- o) • 

By definition we have (recall that Ei^n{tkn) = I + tknEkn) 

Skn{tkn) = {y, {h{x,Ekn{tkn)) " /)) = tT(tknEknB{x, y)) , 

hence by analog of the Lemma 12.111 we conclude that 
(3.20) 

S = {Skn{l))k,r = {ii{EkrB{x,y))\^ = B^{x,y) = (x(-))V(x;.^)^ = (o Y^^-)") 
So, we have 

(3.21) S{h{x, t)) = exp(27ri(?/, {h{x, t) - I))) = exp (2mti ((t - I)B{x, y)) ) . 

Using results of [12] we conclude that the following lemma holds. 

Lemma 3.13. The measure fib = fJ'b,m ® yU^™"* is Bmfl x B^^ -right- erg odic if 

= 2^ —7 < oo. 

k<n<m 

Theorem 3.14. The induced representation T"*'^ of the group Bq defined by formula 
Ii3.16\) . corresponding to generic orbit Oy, generated by the point 

y = ^'^Qym+r+i,m-rEm+r+i,m-r ^ ^2(0.) is irrcduciblc if the measure lJ,b,m^l^b^^ on the 
group B„i x iJ^*") is right B^ q x B^"* -ergodic. Moreover the generators of one-paramet 



er 



groups Akr = df^TnEkr l*=o follows 

fc-l k-l 

Akr = ^ ] XksDrs + Dkr, {k,r) G A^'"^ Akr = ^ ] XksDfg + -Dfcr; ik,r) G Am, 

s=— 00 s=m+i 

(27rO-i(A,,)(^^^)^^(^) = = {Skr)iKr)eH^) = {x^^'yx^-'Y ■ 

Here we denote by Dkn = E>kn{fJ'b) the operator of the partial derivative corresponding 
to the shift x ^-7■ x+tEkn and the measure fib on the group Bm x -B*^™-* 3 x = I+Yl XkrEkr'- 
(3.22) 

{Dkn{flb)f){x) = ^ f ^f^b{x + tEkn) \ j, _^ ^^^^^ |^^^^ Dknif^b) = 77^ hnXkn- 

dt \ dfib{x) J dxkn 

The irreducibility of the induced representation of the group Bq follows from the follow- 
ing lemma. 

Lemma 3.15. Two von Neumann algebra 21'^ and 21^ in the space "H™" = L'^{Xm,fib) 
generated respectively by the sets of unitary operators Ukrif) and Vkrif) coincides, where 

(3.23) {UUt)f){x) = exp{2mSkrit))f{x), (Vfc,(t)/)(x) := exp(27rztx,,)/(x), 
21^ = (Ukrit) = TT;\e,^ = exp{2mSkrit)) | t G M, (A;,r) G A(m))' 
21^ = {Vkr{t) = exp{2TTitXkr) | t G M, {k,r) G A,„ |J A^'"))". 
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Proof. Using the decomposition fl3.20p 



1\T 



B{x,y) ={x-^^yx' 

we conclude that 21"^ C 21^' (see the proof of Lemma [2 .171) . 

To prove that 21'^ 3 21^' it is sufficient to find the expressions of the matrix element 
of the matrix x^*"-* G i?*^™) and x~} E Bm in terms of the matrix elements of the 
matrix S*^™^ = {Skr){k,r)<^A{m)- To do this we connect the above decomposition E^"^^ = 
B{x,y)^ (see fl3.19p ) and the Gauss decomposition C = LDU for infinite matrices (see 
Theorem 112]). By fl3J9|) we get B{x,y) = x^^yx^'^^ 

To find a matrix connected with the matrix S*^*") , for which an appropriate decompo- 
sition LDU holds we recall the expressions for B[x, y) for small n and finite-dimensional 
groups (see Example (I2.14p ). We note that = /, where 



Jm £ Mat(oo, 



rGZ 



m+r+l,m—r • 



For G\ we get 



B{x,y) 



(3.24) 



B{x,y)J 










Via \ 






X02 


X03 \ 





1/52 







1 


X12 


X13 1 














1 


r ) 








/ 


Vo 











t/43 

1/52 

?/6i 

1/70 













\ f x\z 


1 







1 \ Xi3 




1 





' \ a;03 


X02 


2:01 





We use the infinite-dimensional analog of the latter presentation, i.e. instead of the 
group Gn = -B(n, R) consider the infinite-dimensional group Bq and do the same. Let 



Xn 



G Bm, X*^"'-' G B^^\ y = ym+r+l,m-rEm+r+l,m.-r ^ 02 1*^) 

r=0 

and J = Jm = Y,rez^rn+r+i,m-r- Then we get §^ = B{x,y) = Xm^yx'-"^^- 

Set C = C{x,y) = B{x,y)J then C = UDL, more precisely we have: 
(3.25) 



B(^X,y)J Xm yJmJni'^^ ^ Ji 

(3.26) C = B{x,y)J = 



UDL, where U 



x^'^ D 



7/7 L = 7 r^"") 7 



c 



Cll Cl2 
C21 C22 




?/43 

?/52 

1/61 

J/70 



di 

d2 





10 
a;23 1 

Xl3 X\2 1 
2^03 2^02 X0\ 1 



1 
hi 1 





... 



To finish the proof of the Lemma it is sufficient to find the decomposition fl3.26p 
C = UDL . 

Let us suppose that we can find the inverse matrix C~^. Then by fl3.25p holds C^^ = 
L~^D~^U~^ and we can use Theorem 14.21 to find 



7 fr("'h"^ 7 



D 



-1 



-1 



y Jm, 



u 



-1 



Xr. 



Hence, we can find the matrix elements of the matrix (a;*^™^)^^ G and Xm G B^ in 
terms of the matrix elements of the matrix = (S"^J)^^ = {B{x,y)J)~^. Finally, we 
can also find the matrix elements of the matrix x*^™^ G using formulas fl2.3ip . This 
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finish the proof of the lemma since in this case we have Xkr V Sl*^ for (/c, r) G IJ A*-™\ 
Hence 01^ GW. 

1) To find the inverse matrix we write two decompositions: 

(3.27) C = LiDiUi = UDL, C'^ = {Ui)-\Di)-\Li)-^ = L-^D-^U-\ 

2) Using fl3.27p we can find Li,Di and f/i by Theorem 14. 2[ More precisely, for all 
X G Fg, where 

Tc = {xE Brn X I Mll-i{C{x)) ^0, /c G N} 

holds the decomposition C{x) = LiDiUi and the matrix elements of the matrix Li, Di 
and Ui are rational functions in Cfc„(x). 

3) We can find {Li)~^ and (f/i)~^ using formulas (12.311) . Note that JmLJm, U, and 

JmL-^Jm, G 52(a). 

4) Using identity ([S2ZD we can calculate C'^ = {Ui)-\Diy^{Li)-\ since L-\ D'^ 
and f7~^ are well defined. 

5) Using equality (13.271) we can find the decomposition C^^ = L^^D^^U^^ of the matrix 
C^^ by Theorem 14. 2[ In other words, the decompositions holds C^^ = L^^D^^U^^ for 
all X G Fg-i, where 

Tc-i = {xeB.^x I Mll-i{C-\x)) ^ 0, A; G N} 

and the matrix elements of the matrix and U^^ are rational functions in 

matrix elements c^^(x) of the matrix . 

We make the last remark. Let us denote {Li)^^ = {L^.ln)kn, (-Di)^^ = dia.g{d^.l) k 
and (f/i)-i = {U^^lJkn- The decompositions C = LiDiUi 'and C'^ = {Ui)-\Di)-^x 
(Li)~^ hold for x G F^ H F^-i, i.e. almost for all x G Bm x S^™) with respect to the 
measure fib since //^(Fg H Fg-i) = 1. We conclude that the convergence 

mGN 

holds pointwise almost everywhere x G B„i x B^"^^ (mod /if,). Since f/jT^^, and 
^i mnV^^ by 2) and 3), we conclude by Lemma [5TT] that c^^(x) ?7 21'^. This finish the 
proof of the lemma. □ 

Proof, of the Theorem \!^.14\ To prove the irreducibility of the induced representation 
consider the restriction T^'^ \Bo(m) of this representation to the commutative subgroup 
Bolm) of the group B^. Note that 

21^ = {exp{27TztXkr) I t e M, {k,r) G A^IJA^'"))" = L°°(5^ x 5^™), /i,,^ ® /.f^). 

By Lemma r3.15l the von Neumann algebra 21'^ generated by this restriction coincides with 
_ L°°(^Bm X B^'^\ fib,m ® f^b^^)- Let now a bounded operator A in the Hilbert space 
commute with the representation T™'^. Then A commute by the above arguments 
with L°°{Bm X B'^"^\ ixb,m ® f^b^^)y therefore the operator A itself is an operator of 
multiphcation by some essentially bounded function a G L°° i.e. {Af){x) = a{x)f{x) 
for / G 'H™'. Since A commute with the representation T™'^ i.e. [A, T/"'^] = for all 
t G Brafi X B^"'\ where Bm,o = 5^ n 5^ and 5^"^ = E^*") n 5^, we conclude that 

a{x) = a{xt) (mod fLb,m ® /^l™'') for all t G -Bm,o x _Bq"*\ 

Since the measure fib,m ® f^b"'' on the group Bm x B^"^^ is right -Bm,o x Sg'^^-ergodic we 
conclude that a{x) = const (mod dxm^dx^""^). □ 
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Remark 3.16. We would like to show that T™-'^ = lim„T™'^'\ To be more precise 
consider the projection (—)■ of the group Bq on the subgroup and all other 
projections: homogeneous spaces, measures, Hilbert spaces and representations : 

Xm = Bfn y< B^ I— >■ Xm,n = -Bjn,n ^ B^ ' \ Hb,m ® ^ f^b,m,n ® f^^f, 
= L\B^^n X dx^^n ® dx^^^^^) = H"^'" 

Since the measure ^b,m,n ® is equivalent with the Haar measure (compare f l2.43p 

and fl3.14p ) we conclude that the corresponding representations T^'"^'^" in the spaces 

L^{Bm,nXB^"''''\fXb,m,n®fJ''r'"'^) and T'^'y- in the space L'^{Bm,n^B^'^'''\dXm,n®dx'~"'^"^) 
are equivalent. This implies T"^'^ = lim^T"*'^". 

3.9. Dual description of the groups B^ and B^. First steps. Let G be the dual 
of the group G. Our aim is to describe G for G = lin^^^ Gn where Gn = B^n,^.) is the 
group of all n X n upper triangular real matrices with units on the principal diagonal, 
i.e. we would like to describe the dual of the group Bq of infinite in one direction and 
Bq infinite in both directions matrices. Consider the inductive limit G = lii^^ Gn of 
nilpotent groups Gn = -B(n,]R). The symmetric (resp. nonsymmetric) imbedding gives 
us two infinite-dimensional analog of "nilpotent" groups B^ (resp. B^). 

We do not know the description of all G. We only know that the set G contains the 
following three classes of representations. 

1) The set G contains IJn^" ^ ^ Un^"- Kirillov's orbit method 
[H [7j to describe Gn- The embedding G„ C G„+i is described in Remark [3. 17[ 

2) We have G\[Jn Gn 0- Namely G\[Jn Gn contains "regular" T^'>' and " quasiregular" 
^R,fi,x representations of the group G (see subsection 13.11) . 

3) Induced representations (see subsection 13. 6p . 

It is natural together with the group Bq (resp. Bq ) consider all Hilbert-Lie completion 
i?^(a) (resp. -Bf (a)) and the group of all upper-triangular matrices B^ (resp. B^) (see 
subsections 13.51 13. 4p 

G„ -> -> B^{a) -> 5^ ^ Gn. 

G™ ^ B^ B^{a) ^ B^ ^ G™. 

Together with all imbedding and projections of all mentioned groups G„ = B{n,M.) we 
have: 

B{n, M) 5(n + 1, M) ^ 5^ ^ ^2(0) ^ 5^ ^ B{n + 1, M) ""^^ B{n, M), 
where the imbedding and the projections p^+i are defined as follows: 

B{n, M) 9 X ^ iT^{x) = x + En+i,n+i G B{n + 1, R), 
B{n + 1,R) 9 X = x"+V„ ^K+i(x) = x„ G 5(n,M), 

n 

where = / + Xkn+lEkn+l^ X„ = / + ^ XkmEkm- 

k=l l<k<m<n 

For groups ~ i?(2n, M) defined by fl2.4ip consider the homomorphism Pn+i"" '■ 
G^+i ^ G™ defined as follows (for simplicity we define p^'^i" for m = 0) 

G^j^^ 3 X = X^ XnX_^ I y Pn-\-l (•^) ~ •'^n ^ 
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where 



—n<k<n+l — n<fc<n+l 

Remark 3.17. T/ie embedding B{n,W) ^ B{n + 1,]R) (resp. G™ i-)- G^+J «s induced 
by the homomorphism \3.9^] p^+i '■ B{n + 1,M.) i— t- B{n,M.) (resp. by the homomorphism 

M) p^'+i" : G^+i ^ 5o /or m e Z u;e get [j^^-^Ct^ C 5^. Similarly, we have 

Let us denote by -B^(a) (resp. i?f (a)) the completion of the subgroup Bq C GLo(2oo, M 
(resp. Bq C GLo(2oo,M)) in the Hilbert-Lie group GL2(a). Since (see 0) 

B^=^B'^{a) (resp. i?o" = fj («)) 

we conclude that 

B^=[jBf{a) (resp. = (J ^M). 

It leaves to describe -B^(a.) (resp. i?f (a)) for all a G 21. The problem of developing 
the orbit method for the Hilbert-Lie group B^{a) (resp. -Bf (a)) could be easier, since 
the corresponding Lie algebra bf (a) (resp. bf(a)) is a Hilbert-Lie algebra, the dual 
(b2 (a))* (resp. (b|(a))*) and the pairing between bf (a) (resp. bf (a)) and (ba (a))* 
(resp. (bf(a))*) are well defined (see subsection 13.61) . 
Using (13. 9p we conclude 

(3.28) = lii^S(n,R), 5^ = JimS^(a), fi^ = 1^5(n,M), 

n,i a n,p 

B^ D B^) D B^, 

finally we conclude that 

(3.29) Bl=[jBf{a), 9> = [j GI = [j B{^) . 
The similar relations holds also for groups Bq C -Bf (a) C B^. 

Definition 3.18. We call the representation of the group G = Ih^^ G„ local if it depends 
only on the elements of the subgroup Gn for some fixed n eN. 

The last relation in (13.281) and (13.291) we can reformulated as follows: 

Theorem 3.19. (V.L. Ostrovsky, PhD dissertation, 1986). The class of all irreducible 
unitary local representations of the group B^ = lin^ B{n,Wj coincides with the class 

UnGn. 

4. Appendix 1. Gauss decompositions 

4.1. Gauss decomposition of n x n matrices. We need some decomposition of the 
matrix C G Mat(?2, C). Let us denote by 

iW];£;:}:(G), l<H<...<ir<n, l<j,< ... <jr<n 

the minors of the matrix C with Zi, Z2, v rows and ji,j2, ■■■,jr columns. 
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Theorem 4.1 (Gauss decomposition, [2J). A matrix C G Mat(?7.,C) admits the following 

decomposition C = LDU (Gauss decomposition), 

(4.1) 

/ Cii Ci2 . . . Cin \ / 1 ... \ / di ... \ / 1 ^12 . . . Uin\ 



C2I C22 



C2n 



21 







do 















U2n 



dn J \ 







\ C„i C„2 • • • Cnn ) \ l-nl ln2 ■ ■ ■ / \ ^ 

where L (resp. U) is lower (resp. upper) triangular matrix and D a diagonal ma- 
trix if and only if all principal minors of the matrix C are different from zeros i.e. 



1 



^i'2' 'kip) 7^ 0; 1 < k < n. Moreover the matrix elements of the matrices L, U and 
D are given by the formulas (see [21 Ch.II, §4, (44), (45)] j 

j^l,2,...,A:-l,m/^\ , ^l,2,...,fc-l,A: 

(4.2) Ijyik ,,19 hZITTTTZr y 



1,2,. 



,k-l,k 



1 < k < m < n, 



(4.3) 



di = Ml{C), 4 



2<k<n. 



Proof. If we write L = DU, we get 
this implies (14. 3p . Moreover, we get also 



di . . . dj. 



Mlt:t:liiL-'C) = Mg;;;;n;:(C^) = <2t:,K:(^t^) = • • • dkUkm, k < m 



rl,2 k-l,k 



l,2,...,fc-l,fc 



this implies the second formula in (14. 2p . Similarly if we write CU ^ = LD we get 
this implies the first formula in (14. 2p . 



□ 



4.2. Gauss decomposition of infinite order matrices. Let us consider the infinite 
matrix C, L,D,U e Mat(oo, C). 

Theorem 4.2 (Gauss decomposition C = LDU). A matrix C G Mat(oo,C) admits the 
following decomposition C = LDU (Gauss decomposition), 



(4.4) 



Cll C12 
C21 C22 



Cnl C„2 



C2r, 





1 

ln2 



' dl 
d2 








dn 




where L (resp. U) is lower (resp. upper) triangular matrix and D a diagonal matrix of 
infinite order if and only if all principal minors of the matrix C are different from zeros 
i.e. M-|^'2''"'^(C) 7^ 0, k E N. Moreover the matrix elements of the matrices L, U and 
D are given by the same formulas as in the Theorem \4.1\ ' 



(4.5) 



(4.6) 



l,2,...,fc-l,m 
k-l.k 



mk 



1,2,... 



di = Ml{C), dk 



Ukn 



{cy 



M- 



l,2,...,fc-l,fc 
l,2,...,fc-l,A: 



/c, m G N, k < m, 



keN, k>l. 



Proof. The proof repeat word by word the proof of the Theorem 14.11 



□ 
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5. Appendix 2. One elementary fact concerning abelian von Neumann 

algebras 

Let {X,T,ii) be a measurable space, with a finite measure IJ>{X) < oo, where is a 

sigma-algebra. Consider the set (/„) = {fn)nen of measurable real valued functions on 
X i.e. /„ : X I— )■ M. Denote by B{H) the von Neumann algebra of all bounded operators 
in the Hilbert space H = L'^{X,n) and let 2l(-^")(e B{H)) be a von Neumann algebra 
generated by operators Un{t) of multiplication by functions exp{itfn{x)), n e N 

2t(/") = (Unit) = e''f" \nen,te R)". 

We are interesting in the following question. Let ^ / as n ^ oo in some sense. 
When U{t) = e'^f e for all t e R? 
Since 

is a von Neumann algebra it is sufficient to find when the strong conver- 
gence of the unitary operators in the space H holds i.e. s. lim„ Un{t) — U{t), where the 
operators Un{t), n G N and U{t) are defined as follows 

{Un{t)g){x) = e''M^^g{x), {U{t)g){x) = e^'f^^^g{x), g e L'{X,pi), t e K. 

Lemma 5.1. Let /„—)>/ as n ^ oo pointwise almost everywhere, then s.lim„C/„(i) = 
U{t) hence U{t) = e^*-^ e , 

Proof. For g e H we get 

WiUnit) - Uit))gr = [ I (e^*^"(-) - e^'^^-^)gix) \' d/^ix) = 

Jx 

f I ^itU{x)-itf{x) _ ^ |2| |2 ^^(^^^ ^ f I ^itan{x) _ ^ |2| ^^^-^ |2 ^^(^^^ ^ q 

Jx Jx 
as n — )■ OO, if := fn{x) — f{x) pointwise almost everywhere by Lebesgue's 

dominated convergence theorem. □ 
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